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ABSTRACT 

The California Mathematics Project was established in 
1982 by the California State Legislature as one of several statewide 
responses to a widespread perception among educators and the public 
at large that the mathematical competence of American children has 
deteriorated. This report describes an attempt to evaluate the first 
year's work of one site of the California Mathematics Project. The 
Legislation provides for several levels of responsibility for the 
evaluation of the California Mathematics Project, one of which is the 
local project level. This project report consists of seven sections. 
Following the introduction is a profile of program participants. The 
second section summarizes the participants* reaction to and 
assessment of the 1986 Summer Institute, based on exit interview 
data. This is followed by an analysis of survey data gathered at the 
end of the Summer Institute. The fourth section of this report 
provides an analysis of data based on a survey of instructional 
practices in mathematics. This section describes and compares 
self-reported instructional practices of participants, a group of 
teachers trained by participants, and a comparison group of teachers. 
The survey instrument used in the collection of these data reflects 
instructional practices advocated in the California Mathematics 
Framework. The results of a year-end telephone interview with Fellows 
forms the basis for the next section of this report. This is followed 
by a discussion. (TW) 
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MONTEREY BAY AREA MATH PROJECT I 
FIRST YEAR EVALUATION 

Ronald W. Henderson and Nancy Brown 

Introduction 

The California Mathematics Project was established in 19B£ 
by the California State Legislature <Senate Bill 4B4) as one of 
several statewide responses to a widespread perception among 
educators and the public at large that the mathematical 
competence of American childrsn has deteriorated. This report 
describes an attempt to evaluate the first year's work of one 
site* of the California Mathematics Project. The Legislation 
provides for several levels of responsibility for the evaluation 
of the California Mathematics Project, one of which is the local 
project level. Although this is an evaluation of the Project at 
a single site, some knowledge of the larger context of the 
Project is essential to the interpretation of this local effort. £ 

The legislation that created the California Mathematics 
Project was generated in a milieu of immense apprehension about 
the ability of the products of American schools to function 
within a society in which technology is increasingly pervasive. 

*The Monterey Bay Area Mathematics Project, based on the 
campus of the University of California, Santa Cruz, Edward M. 
Landesman, Principal Investigator 

*A more complete description of the California Mathematics 
Project is provided in Evaluation of tha California Mathematics 
Project - Report BG-34. Sacramentos California Postsecondary 
Education Commission, 1986. 
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Special expression* of concern were voiced by leaders in business 

and industry because American students compare poorly with their 

peers in other technologically advanced nations {California 

Postsecondary Education Commission, J 986), dulling any 

competitive edge the United States, and California in particular, 

may have had- The nature of the problem has been described in 

numerous reports mill, 1981; National Commission on Excellence 

in Education, 1383$ National Science Board Commission on 

Precollege Education in Mathematics, Science and Technology, 

19B3* Peng, et aj, 1384* Tyack, Kirst * Hansot, ISaOJ, but the 

spirit of the Legislature's perception is best captured in the 

language of the legislation itself, which attributes the decline 

in mathematics skills, in part, tot 

<m) Inadequate mastery by students of the mathematics 
techniques taught in high school, resulting in poor 
comprehension of college course-work and high attrition 
rates for those students who have these deficiencies. 

(b) P tendency among young women to avoid taking advanced 
mathematics courses in high school, which limits their 
choice of educational options, and screens them out of 
future careers in science, engineering, and other 
mathematically related professions. 

<c) Lack of mathematics instruction at the elementary school 
level to enable all students, including female, minority, 
and low-income students to develop skills and attitudes 
which will enable them to pursue mathematics successfully in 
later grades. 

id) Concentration on minimum computational abilities, at all 
levels of schooling, with the result that opportunities for 
students to develop probl ero-soiving skills necessary to 
advance to college mathematics or to jobs in technical 
fields may be available. 

The Legislators recognized that improvements in the pre- 
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service education of teachers were necessary, but of themselves 
would wake little impact on the improvement of mathematics 
education. They thus realized the additional need "... to 
assist existing teachers in gaining skills necessary to "increase 
mathematics proficiency amoral students. M 

The charge to the California Mathematics Project was a very 
broad one- It translates into four goals (California 
Post secondary Education Commission <p. 6, 1985). Thay are to: 

J. Improve the quality of mathematics teaching in 
California. 

2. Develop mathematics teachers as leaders in order to 
disseminate strategies, ideas, and techniques, to 
encourage appropriate attitudes, and to magnify the 
beneficial impact of the project 

3. Coordinate efforts of the Project with activities (of 
post secondary institutions, local schools, state 
agencies, and industry) directed to the improvements of 
mathematics teaching 

4. Increase awareness of the importance of mathemati s 
education and the current issues and efforts in 
mathematics education by communicating with governmental 
officials, lay boards a^ various levels, parents, and 
industry groups, teacher educational professionals and 
the general public 

It would be folly to attempt to evaluate a project's success 
with respect to all of these goals during its initial year of 
operation, even if resources to do so were available. This 
evaluation focuses primarily on efforts and accomplishments 
associated with the first two of these goals, and ever then the 
approach is selective. The legislative intent behind the 
California Mathematics Project initiative was to increase the 
mathematical competencies of students in California's public 
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schools. Given that intent, it is c2ear2y important, at an 
appropriate point in time, to assess the program's influence on 
student performance. The perspective followed in designing the 
evaluation effort reported here takes the position, however, that 
it would be prematura to attempt to assess effects on student 
behavior until we arj in possession of some information on the 
project's implementation and its influence on the attitudes and 
behaviors of the educators who are touched by it. Thus, this 
evaluation focused on the reactions of project participants to 
the training provided. Within the severe restrictions imposed by 
resource limitations, it also attempted to 1) identify changes in 
the participants' teaching of mathematics that might be 
attributed to the project, 2) determine whether or not the 
project produced a multiplier effect such that participants 
contributed to the professional development of other teachers of 
mathematics, and 3) undertake an exploratory examination of the 
effects of dissemination efforts by participants on the 
instructional behaviors of their colleagues. 

In brief, our evaluation efforts were based on the 
assumption that it makes little sense to measure changes in 
student behavior until there is some evidence of changes in those 
instructional practices that reflect project goals- The 
California Mathematics Project is a broad-based effort to improve 
the status quo in mathematics education. The authors of a recent 
publication of the Association for Supervision and Curriculum 
Development Word, Rutherford, Hul ing-Austin * Hall^ 19B7) remind 
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us that innovations involving curricula and instructional 
strategies have usually failed, and in most cases there is no way 
to know whether they failed because the ideas were flawed or 
because they were never implemented properly. Our position is 
congruent with that observation, and has influenced us ask if 
anything has changed in classroom processes and curri cu lar 
content as a result of the Project. Even this modest effort is 
fraught with difficulties because resources were not available, 
and presumably never will be, to do e firsthand study of 
instructional process in classrooms conducted by Fellows or by 
teachers they have influenced. Thus, the activities reported 
here represent, in part, an exploration of the possibility of 
obtaining useful evaluative information via teacher self report. 

This report consists of 7 sections. Following this 
introduction we provide a profile of program participants. 
Applicants who were accepted into the ProqrAta for 1936-37 were 
designated Monterey Bay Area Mathematics Fellows. In this report 
they are referred to either as participants or Fellows. The 
second section summarizes the participants' reaction to and 
assessment of the UBB Summer Institute, based on exit interview 
data. This is followed by an analysis of survey data gathered at 
the end of the Summer Institute- The fourth section of this 
report provides an analysis of data based on a survey of 
instructional practices in mathematics. This section describes 
and compares self-reported instructional practices of Fellows, a 
group of teachers trained by Fellows, and a comparison grouo of 
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teachers. The survey instrument used in the collection of these 
data reflects instructional practices advocated in the California 
Mathematics Framework (California State Department of Education, 
1985). 

The results of a year-end telephone interview with Fellows 
forms the basis for the next section of this report. This is 
followed by a discussion. 

Profile of Institute Participants 
fl Pre-Institute survey form provided by the California 
Mathematics Project was sent by Monterey Bay Area Mathematics 
Project staff tc all teachers who were chosen to participate in 
the 19&6 Mummwr institute. Sixteen <of the £3) participants 
returned completed forms. Project administrators made these 
form% available to the evaluator for use in preparing this 
report. 

The Pre-Institute Form was divided into -topical sections 
pertaining to* 1) The Teaching of Mathematics, 2) Educational 
Leadership in Mathematics, 3) Mathematics Autobiography, 4) 
Demographics and 5) Expected Project Outcomes This report draws 
selectively froa the information provided by the Pre-Institute 
Form, as a means of providing a profile of the 1986 institute 
participants. 
Demographics 

Five male and 11 female participants responded to the 
Pre-Institute survey. Of these, the ethnic background of one was 
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Asian, two were Hispanic, and the remainder were non-Hispanic 
white. Two of the women taught in the primary grades? three 
women and one man taught in the intermediate grades; three men 
and five women were from junior high or middle schools; and one 
male and one femalm respondent reported high school teaching 
assignments. Years of teaching experience among the participants 
ranged from 1 1/2 to 2B years, with a mean of 12.&9 and a 
standard deviation of 9.4. 

The formal mathematics education of participants ranged 
from high schoc.l geometry in - i> to a MAT degree in mathematics 
(n » 1). No one held an MA degree in mathematics. Two 
participants, in addition to the MAT degree holder, had majored 
in mathematics in college and seven had minored in the subject. 
Seven participants had taken no mathematics course work beyond 
trigonometry or some other fourth year high school course. 
Institute participants came from schools that were either 
predominantly Hispanic or non-Hispanic white in student 
composition. Asians represented about 12% of the population in 
one school, but in all other schools Asians constituted 5% or 
less of the student body. Five teachers were from schools in 
which half or more of the students were Hispanic, and in two of 
these cases the proportions were 90* or more. The schools 
represented by five participants had student populations that 
were 70* or more non-Hispanic white. The schools represented by 
Institute participants served very few Black students. In one 
school, 15* of the students were Black, in another 5* were Black, 
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and in ail others 2% or less of the students were reported as 
Black- 

Self-Described Teaching Practices 

Part J * *~nts were asked to respond to a rating scale 
devised to describe their own teaching- The response format was 
a 5-poin* Likert-type scale, with response alternatives ranging 
from "Not at all descriptive* <1 point) to "Very descriptive** tS 
pints). The specific questions were as follows* 
In teaching mathematics, I 

a) feel enthusiastic about the subject. 

b) make special efforts to minimize math fear or anxiety. 

c) give personal help to students who have difficulty. 

d) stress problem-solving process, rather than solutions- 
e> encourage students to guess or to ma^e estimates. 

f) have students mpply concepts to demonstrate understanding. 

g) test for conceptual understanding. 

h) have students discover concepts using manipulative*. 

i) set aside time for exploring mathematical ideas, 
j) use "real world** examples of problems whenever possible. 
k) present information on women mathematicians/ scientists. 
1) know when students are bored or confused, 
m) invite students to share knowledge or observations, 
n) have students work in small groups. 

o) engage students in math contests, puzzles, problems of the 
day, etc. 

Descriptive statistics for the responses to these items are 
presented in Table 1. In qmrtmrml,, participants reported the 
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statements to be highly descriptive of their own teaching 
behavior, with most means fall ins abov? 4, on a 5 point scale. 
The lowest means and greatest variability were found for items 
"h* (i.e.., having students discover concepts using 
manipul at ives), »i» <i.e. setting aside time for the 
exploration of mathematical ideas), and w k" (i.e., presenting 
information on women mathemat icians/ scientists) . 



Table 1 

Descriptive Statistics for Self-Reported Descriptions of Teachi 
Behavi or 



Item 


N 


Win. 


Max. 


Mean 


SD 


a 


16 


4.d 


5.0 


4. 69 


.46 


b 


IB 


3.0 


5.0 


4.36 


.62 


c 


16 


3.0 


5.0 


4. 19 


.65 


d 


IB 


2.0 


5.0 


4.06 


1.00 




IB 


1 0 


5.0 


4. 13 


.96 


f 


IB 


£.0 


5.0 


4.00 


.72 


9 


16 


3.0 


5.0 


4. 06 


.65 


h 


IB 


1.0 


5.0 


3. £5 


1.29 


i 


IB 


1.0 


5.0 


3. 13 


1.36 


J 


IB 


3.0 


5.0 


4.36 


.72 


h 


IB 


1.0 


5.0 


S. 31 


1.25 


1 


IB 


3.0 


5.0 


4. 19 


.75 


m 


IB 


8.0 


5.0 


4. 13 


.96 


n 


IB 


2.0 


5.0 


3.44 


.89 


o 


IB 


3.0 


5.0 


4. 19 


.83 



Pearson correlations were computed as an initial means of 
exploring whether variations in the responses self-descriptions 
of teaching practices might be related to background variables. 
Table 2 reports correlations for only tbos* sterns that were found 
to correlate significantly with one or more of the background 



variables* of gender, highest level of mathematics completed, 
years of teaching experience, or grade level of teaching 
assignment. 



Table £ 

Self-Descriptive Statements of Teaching Correlated with 
Background Variables 



Background 
Variable 



Item 



n 



Bender IS . 46 .37 .34 



Math 

Completed . 50* - m 65** 44 



Teaching 

Experience -.14 -.05 .12 -.33 

Grade Level . 33 73** 6e** 71 ** 



Coding for the background variables was* g«r*der <male « 1, 
female ■ 2), math completed <a ten point scale, ranging from i 
for Algebra I to 10 for M.fl. in mathemat ics>, teaching experience 
tl point for each year) and grade level (primary grades » 1^ 
intermediate grades - 2, junior high or middle school - 3, and 
hj'gh school » 4). 

It is interesting to note that neither teachers* gender nor 
teaching experience were significantly correlated with any of the 
self --descriptive statements. Enthusiasm for the subject was 
associated with participants 9 level of mathematics training, 
while both mathematics background and grade level taught were 
negatively associated with the use of manipulat ives to help 
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students discover concepts (item »h M ). The greater the amount o 
formal mathematics training, and the higher the grade level 
taught, the less teachers tended to use manipulat ives. 

Given that level of teaching assignment and level of 
mathematics training attained by teachers covary (r » .66 in 
this sample), a multiple regression analysis was employed to 
explore the question of which o^ these variables accounted for 
the greatest portion of the variance in self-reported use of 
manipulables for mathematics concept discovery. Ratings for the 
item were regressed on mathematics background and grade level of 
the teaching assignment. Th* multiple R was .762, R2 = .581, a 
{ .004 <df 2, 13). Only the standardized coefficient (-.533) for 
grade level was significant fa < .045), suggesting that 
differences in the use of manipulables is attributable primarily 
to grade level, ar>d is not a product of the level of the 
teacher's formal mathematical education. 

Items n i u (setting aside time for the exploration of 
mathematical ideas) and »n M (having students work in small 
groups) were both negatively correlated with the grade level of 
the participants' teaching assignments, indicating a greater use 
of these approaches in th* lower grades. 

Expected Project Outcomes 

A series of rating scale items asked participants to rate 
the extent to which they expected the California Mathematics 
Project to increase or expand their* 
a) knowledge or understanding of mathematics. 

11 



b> empathy fair students learning Mathematics. 

c) repertoire of problem-solving strategies. 

d) enjoyment of mathematics teaching. 

e) awareness of resources for teaching mathematics. 

f) self confidence in teaching mathematics. 

g) understanding of math curricula across grade levels. 

h) belief in the need for changes in math curricula. 

i) repertoire of techniques for teaching mathematics. 

j) use of concrete m* berials and manipulat ives. 

k) standards of evaluating student performance in a;ath. 

2) ne* *ork of contacts with other matn teachers. 

m) discussions about math teaching within your school. 

n) commitment to increasing minority and female participation in 
mathematics* 

o) pride in teaching as a profession. 

p) familiarity with uses of microcomputers in math teaching, 
q) ability to develop inssrvice presentations, 
r) appreciation of process in learning. 

The descriptive statistics presented in Table 3 reveal a 
pattern of greater variability in outcome expectations for the 
California Mathematics Project than was true for the 
self -descriptions of teaching behaviors. 

Simple correlations are presented in Table 4 for all 
expectation items that were significantly associated with any one 
experience, mathematics background, or grade level. 

The significant correlations in Table 4 identify a number ^F 
interesting relationships between expectations of project 

IB 
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Descriptive Statistics on Participant Expectations for 
Mathematics Project Outcomes 



Item 


N 


Win. 


Max. 


Mean 




a 


16 


1.0 


5. 0 


3 AA 


I • (Jo 


b 


16 


2.0 


5.0 






c 


16 


4. 0 


5. 0 




ACT 


d 


16 


1.0 


5. 0 






e 


16 


3. 0 


5.0 




DO 
• DC 


f 


16 


1.0 


5. 0 


3. 69 


t t A 

J. • JL *r 


3 


16 


£.0 


5.0 


4.06 


1.00 


h 


16 


t Ol 

-i . If 


Zfm SO 


3. 81 


1. 38 


i 


16 


£.0 


5.© 


4. 50 


.89 


3 


16 


1.0 


5.0 


3.81 


1.38 


k 


16 


£.0 


5.0 


3.88 


1.09 


1 


16 


2.0 


5.0 


4. 00 


.97 


m 


16 


3.0 


5.0 


4, 13 


.61 


n 


16 


£.0 


5.0 


3.63 


1-15 


© 


16 


1.0 


5.0 


3.88 


1.09 


P 


16 


3.0 


5.0 


3.94 


.68 


q 


16 


1.0 


5.0 


4. 18 


1. 05 


r 


16 


2.0 


5.0 


4.06 


1.00 



Table 4 

Project Expectations Correlated with Background Variables 

lira 



aacngrouna — 
Variable a 


b 


d 


f 


b 


i 


J 


n 


0 


q 


Bmrtdmr -.22 


.41 


.39 


.42 


.£J* 


.55* 


.56* 


.£6 


.43 


.52* 


Math 
Back- 
ground -. 4fl* 


-.48* 


-.59* 


-. 75*<< 


-.35 


-. 61*4 


t -.55* 


-.34 


-.54* 


-.34 


Teaching 
£xp»r- 
ianca . £9 


-.15 


-.52* 


-.37 


-.43 


-.57 


-.5£* 


-.30 


-.39 


-.49 


Grada 

Level -.20 


-.53* 


-. 35 


-.59* - 


.39 - 


-.59* 


-.53* 


-. 6J** 


-.40 


-.35 
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a higher expectation for increased or expanded 

Knowledge of mathematics titem "a*> than did teachers at higher 
grade levels. Teachers who had less formal background in 
mathematics than their fellow participants, and who taught at the 
lower grade levels, tended to express the expectation that the 
project would help them to feel greater empathy for students 
learning mathematics <item M b"). Math background and years of 
teaching experience were both negatively associated with the 
expectation that the project would help them to experience 
increased enjoyment in teaching mathematics <item "d")- Math 
background and grade level were negatively related to the 
expectation of increased self confidence in teaching mathematics 
<item M f w ). Item *h% which expressed the expectation that the 
project would lead participants to an increased belief in the need 
for curricular changes in mathematics was positively associated 
with gender* indicating that women held this expectation more 
strongly than men. 

Item "i» was significantly irelBtsd to all four background 
variable*. A program outcome involving an mxpartdmd repertoire of 
techniques for teaching mathematics was anticipated more strongly 
by women than men, more by teachers with relatively lower levels 
of formal preparation in mathematics, more by the less experienced 
teachers, and more by teachers in lower than in upper grades. The 
same pattern held for expectations involving 
increased use of concrete materials and manipulat ives. 

Item "n*, indicating an expectation for an increased 
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commitment to enhanced participation in mathematics by women and 
minorities was strongly associated with grade level- Lower grade 
teachers expressed stronger expectations for this outcome than did 
teachers in the higher grades. Teachers with relatively little 
formal mathematics training expressed stronger expectations that 
the project would enhance their pride in teaching as a profession 
than did teachers with more formal education in mathematics. 
Finally, female participants and those with fewer years of 
teaching experience were stronger than males and more experienced 
teachers in expressing the expectation that the project would 
enhance their ability to develop inservice presentations- 
Educational Leadership in Mathematics 

The educational leadership section of the survey requested 
information on the frequency with which teachers had engaged in 
certain activities, such as demonstrating techniques for other 
teachers, or preparing a grant proposal. Approximately BB percent 
of the participants had been asked by another teacher how they 
teach a particular math concept. Thirty-one percent had been 
asked to visit another teacher's classroom to observe and give 
feedback, and the same proportion of participants reported that 
they had been asked by a peer to teach a certain concept or 
demonstrate a technique for teaching mathematics. Only £5* had 
been asked to develop a special math-related event at their 
school, although half had organized informal discussions around 
the teaching of mathematics with other teachers in their schools 
or districts. Approximately 38* reported having written at least 

15 

20 



one computer program or having used computer software to teach 
mathematics, and 31* had written a grant proposal to improve 
mathematics teaching- Twenty-five percent, on at least one 
occasion, had conducted an inservice workshop or presentation for 
other teachers on some aspect of mathematics education. 

Participants also responded to a series of items pertaining 
to their use of new approaches, attendance at professional 
meetings, administrative support for their ideas about teaching, 
feelings about making presentations, self -percept ions of 
leadership qualities, and perceptions of the impact teachers can 
have on change in mathematics education- Descriptors for the 
Likert scale categories for these items ranged from "Strongly 
Agree" <4 points) to "Strongly Disagree" <i point). Descriptive 
statistics on responses to these items are presented in Table 5. 

From these responses it mppaars that the majority of this 
group of participants felt rather strongly that they employ new 
methods and materials in their mathematics teaching. Similarly, 
most, but not all, reported frequent attendance at meetings for 
the propose of improving their effectiveness as teachers, and the 
majority thought their ideas about teaching were respected by 
administrators at their school- Some of the participants appear 
to feel somewhat uncomfortable leading discussions or making 
presentations to peers, administrators, or parents, but most did 
not feel great discomfort in carrying out such tasks. 

There was a fairly strong self-perception of leadership 
qualities among members of this group. Furthermore, t^ere was a 
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strong sense of optimism that teachers can play an important role 
in bringing about change in mathematics education. 
Mathematics Experience and Participation 

Table 5 

Self -Description* of Math Education Leadership Characteristics 



Item 



Mean 



SD Win Max 



I often use new approaches and 
materials in teaching mathematics. 

b. I frequently attend workshops, 
conferences or institutes hoping 
to improve my effectiveness as a 
t eacher . 

c. Administrators at my school are 
generally supportive of my ideas 
about teaching. 

d. I am uncomfortable leading dis- 
cussions or making presentations 
before other teachers, admini- 
strators, or parents* 

e. I consider myself to have leader- 
ship qualities. 



3. 25 



3. 56 



3. 50 



£. 80 



58 



81 



£3 



SB 



3. 38 - 50 



f - Teachers can pi my an important 
role in influencing change in 
mathematics education. 



3. 75 



.45 



Information on the participants* teaching experience and 
educational background in mathematics was presented earlier. In 
addition to these characteristics, information relating to their 
own experiences as mathematics students in high school was 
obtained. Specific information on membership and participation in 
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major mathematics education organizations was solicited using a 
five poAnt Lifcert-type scale with response alternatives ranging 
from -Not at all descriptive" <1 point) to "Very descriptive" <5 
points). 



Table S 

Self-Descriptions of High School Math Experiences 



Item 



Mean SD Min Max 



When I was a high school students 

a. mathematics was one of my 

favorite subjects. 4.25 lmQ Q 2 



b. teachers encouraged me to continue 
ay math education. 

c. I avoided mathematics whenever 
possible. 



3. SB 1. AS 1 
1.19 .54 1 



d. most of my math teachers were 

very good. 3-BJ im ls . 

e. mathematics was generally easy 

for me. 4- OS i. 12 2 



In general , participants reported having enjoyed 
mathematics in high school, but encouragement to continue their 
mathematics education was less than universal. As a group, they 
had not avoided mathematics courses, but neither did they consider 
the statement that most of thei^ math teachers had been very good 
as highly descriptive of their experience. For the majority, 
mathematics had seemed relatively e^sy. 

Table 7 shows the frequency of membership and participation 
in conferences and meetings of professional mathematics education 
associations. Membership in the California Mathematics 

IB 



Association was more common than membership in any oth 



Tmblm 7 

Participation in Professional Associations 



Type 
Activity 


NCTM 


CMC 






L/nm 


Member 


Yes No 
4 12 


Yes 

7 


No 
9 




Yes No 
2 14 


Attend Mtg»s 
or Cortf* 


Nvr Dec Ofn 
13 a i 


Nvr Dec 
10 4 


Ofn 
2 


Nvr 
14 


Occ Ofn 
2 0 



mathematics education association, with 7 of the 16 respondents 
claiming affiliation. Frequency of membership in national or 
local and regional associations was very low. The rate of 
participation in the conferences and meeting's of these 
associations was even more sparse, with a substantial majority 
indicating that they never attended. 
Summary 

In general, the teachers who participated in the Monterey Bay 
Area Mathematics Project during this initial year appear- to be 
reasonably representative of teachers in the region served by the 
project. They display considerable variation in their own formal 
preparation in mathematics, as would be expected considering that 
they represented the entire K-12 grade range in their teaching 
assignments. It is interesting, and probably not atypical, that 
seven of the 16 teachers who provided data had no formal 
mathematics coursework beyond what, under present circumstances, 
would generally be considered to be high school level w «th. 
Contrmry to what some school critics might expect, the majority of 



the participants reported generally positive experiences in their 
own mathematical education and the overall tendency toward "math 
avoidance" was very low- On the other hand, relatively few had 
received encouragement to continue their mathematics education. 

The nature of the student populations served by the schools 
represented by these teacher- was also fairly representative of 
the area- Some schools were predominantly bispanic, others 
predominantly non~hi spanic white, and others a mix of these 
populations. The schools represented served relatively few Asians 
or Blacks- If teachers of Black students are to be included in 
greater numbers it will probably be necessary for the Project to 
draw more participants from Monterey County than from Santa Cruz 
County- 



Daily Assessments of Summer Institute Activities 
A questionnaire completed by participants at the end of each 
day during the Summer Institute provided the staff with formative 
evaluation information- The staff used this daily feedback on 
Institute activities and content to make adjustments in the 
program. 

Each questionnaire employed a likert-type format and had two 
distinct sections. Items in the first section asked participants 
to rate each activity or topic for interest level, clarity of 
presentation, and perceived usefulness. Participants responded to 
the item for each activity by circling a number from 1 to 5, 5 
representing the descriptors "very interesting," "very clear," or 
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-very useful, » as appropriate. The second section included 
questions intended to elicit participants' perceptions of the 
applicability of the activities and topics to their own teaching 
situation. The questions asked whether each activity was 1) 
applicable to the individual's teaching situation, S) an activity 
they planned to implement, 3) a practice already familiar to other 
teachers at their school, and 4) already included in the 
instructional practices being used by teachers in their school who 
were familiar with the ideas inherent to the activity. Again, 
participants were asked to circle a letter representing their 
opinion, from strongly agree to strongly disagree, with an option 
for no opinion. A sample copy of the questionnaire for one day of 
the Institute is displayed in Appendix A. Participants also wrote 
suggestion cards at the end of each day, to be considered along 
with the structured data from the questionnaire in making 
adjustments in structure, activities, and presentations. 

In general , the daily feedback on institute activities and 
content were very favorable. In some cases, activities and 
content were perceived as better suited to application at one 
level of instruction than another. It was interesting to note 
that participants tended to rate activities and topics as 
interesting and clearly presented even when they perceived its 
direct applicability to their own situation as moderate- or less. 

During the planning of the institute their was some 
difference of opinion regarding the use of activities involving 
stations. Some staff members thought that secondary teachers 
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might respond less favorably than lower grade teachers to the 
procedure of rotating through stations. The data indicated that 
stations were consistently among the most favorably rated 
activities. 

Overall, the sessions on logic were among the most highly 
rated, with little variance in the responses. Somewhat 
unexpectedly, participants who taught in the lower grades wey j 
•specially positive in their ratings of the logic sessions, and 
Most of them indicated an intent to implement age-appropriate 
instruction in logic in their classes. 

Data representing participants* estimates of the degree to 
which their colleagues were already familiar with the content and 
activities presented in the Institute, and whether or not these 
practices wrre already in use, suggested that the Institute was 
exposing participants to new material. In many cases participants 
were unable to estimate their colleagues familiarity with or use 
of specific practices. Nonetheless, to the degree that they wer^ 
able to make a judgment, instructional practices based on 
Institute content appeared not to be widely known or practiced by 
colleagues of this group of participants. 

Correlations were computed daily to determine if judgments of 
on topics were associated with gender or level of teaching 
assignment. In roost eases the favorable responses to the topics 
cut across these characteristics. However, women and teachers in 
the lower grades tended to respond more favorably to topics that 
dealt with issues of ethnic and gender equity in mathematics than 



22 



*1 



did men and secondary teachers. 

It is not clear whether gender or teaching level was the more 
important operative variable in this case, since there was a 
moderate degree of colinear.ty between the two variables fr = - 
.35). It may be warranted to make special efforts to wake gender 
and ethnic equity issues salient to groups that may be inclined to 
be less responsive to these topics. 



Summer Institute Exit Interview 
Exit interviews were conducted with each participant during 
the last four days of the summer institute. The interviews 
followed a focused interview approach in which structured 
questions were followed by probes designed to elicit open-ended 
responses from the interviewees. 

The first question asked participants for their overall 
assessment of the summer institute. The responses were over- 
whelmingly positive. One interviewee reported, "I feel really 
inspired ... and also overwhelmed." Many participants reported 
experiencing a considerable degree of frustration and cognitive 
dissonance during the early stages of the institute. 
Nevertheless, they perceived the institute as "very stimulating 
and well worth while." In fact, the task of grappling with initial 
frustration may have contributed to a positive outcome. One 
participant said, "During the first week I thought, »my gosh what 
is going on here?' ... but by this time it is absolutely amazing 
wbat»s happened. I'm starting to think differently." 

S3 



fls a follow-up to the overall assessment question, 
participants were asked if they would have applied to attend the 
institute if they had prior knowledge of what it would be like. 
Twenty-two of the £3 participants responded categorically that 
they would have applied. When asked if they would recommend a 
future institute of this type to a colleague, 21 of the 23 
responded that they would definitely recommend it to a colleague. 

When asked whether the institute had made effective use of 
the participants' time, J5 of the 23 participants responded with 
an unequivocal positive statement. Five participants were 
somewhat more negative concerning . ;e efficiency with which the 
time had been used and three provided answers which could not 
coded as positive or negative. Overall, the participants thought 
the instruction was well structured, but they also observed that 
activities were sometimes too rushed and/or too restrictive. Many 
participants would have welcomed the opportunity for more follow- 
up discussions about the implications of institute material for 
their own grade levels. 

Participants' reactions to the content of the instruction 
varied. One participant suggested "Next time . . . cut the Math, 
or get more time for stations ... for things to be diagrammed 
and discussed. " A contrary opinion was expressed by another 
participant who said that, M J would have liked to have more math . 
. . they did have a crammed schedule, but they were flexible 
enough ... I liked the articulation sessions. " 

In an attempt to assess the institute's ability to 
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maintain interest and attention, participants were asked if the 
institute seemed to go quickly, about right, or slowly. Overall, 
the majority of the participants perceived the time to have passed 
quickly- No one thought the institute moved slowly, although, as 
would be expecteO, a few participants indicated that some days 
Passed more quickly than others. 

In order to gain an impression of the value participants 
placed on activities such as the Institute, the question was 
posed, "If you were an administrator, faced with the pressures of 
competing demands for limited resources, would you allocate funds 
to inservice activities to follow up c.*J topics introduced in the 
Institute?" Nineteen of the 23 participants said yes, t'~> said 
no. Two responses could not be coded. In support of his 
affirmative response, one participant indicated that, "We need to 
get together and share the results of the application of the 
workshop to the classroom." The same sentiment was echoed by 
another participant who said, "That's what would make it a lasting 
thing instead of a summer diversion. » One of the two participants 
who did not think resources should be spent on follow up 
activities indicated that, "I think the monies would be better 
spent for salaries. " 

A commonly heard criticism of training for teachers centers 
on the failure of inservice providers to treat teachers as 
intelligent professionals. Therefore, participants were asked if 
they felt they had been treated as intelligent professionals 
within the context of the summer institute. Eighteen people <7BjO 
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gave an affirmative response to the question. Five voiced 
complaints that they had not been so treated. Reflecting this 
dissatisfaction by a minority of the participants, one believed 
"There was a flaw in the attitude toward us as participants ... 
they talked to us as students rather than teachers." fl 
contrasting perspective on the same issue was voiced by a person 
who said, "I have heard the complaints ... <but) on the other hand, 
it's good when you ... see how the students are treated." It 
appeared that there was some loosening up and change in the 
structure after the first week or so. This change was captured by 
one interviewee who indicated that, "fit first some people may have 
felt they weren't Ttreated like professional s3 . . . but we aired 
it out Tand3 . . . they've asked us to assume a leadership role 
and provide a presentation." The net impact of these comments 
suggests that there was some initial resentment at bei>~3 treated 
like students and a number of participants felt that their 
combined expertise was not utilized to the degree it might have 
been. Most participants, however, felt that they were challenged 
and stimulated intellectually and several f»lt that the initial 
strategy of placing them in the role of student was an effective 
way of generating empathy and understanding for their own 
students. 

During the planning of the project, there was considerable 
discussion and debate concerning whether the project should 
attempt to provide for the needs of teachers across a broad 
spectrum of grade levels or focus its efforts on a more 
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homogeneous group. Ultimately a decision was made to organize 
the project for teachers representing the entire H-12 sector, 
while recognizing the increased burden to workshop instructors 
and the organizational difficulties such an approach would 
entail. In order to obtain the participants' assessment of the 
degree to which the strategy proved effective, participants were 
asked directly if they would have preferred to participate with 
a more homogeneous group of teachers, or if they thought the 
heterogeneous grouping had been effective. Nineteen of the 
participants (82.61*) thought the heterogeneous grouping 
strategy had been effective,, while four thought a more 
homogeneous approach might have been preferable. Many people 
commented on the relative isolation in which teachers work and 
on the general lack of opportunities for professional contact 
with teachers in grades above or below their own. There was a 
general perception that the heterogeneous grouping provided a very 
valuable experience, affording Fellows the opportunity to gain a 
better understanding of the problems encountered by teachers at 
other grade levels, and to become familiar with the expectations 
of teachers at those other levels. Lower gratia teachers were 
overwhelmingly positive about the heterogeneous mix. Typical 
comments were that, "... This is the first timB I»ve ever had 
any interaction with (upper grade teachers)." One junior high 
school teacher valued the heterogeneous experience because, "I 
get to see where my kids are going and where they've been... 
(but) ... it might have been better to have more groups: high 
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school, intermediate, and primary. - Several participants did 
indicate that they thought it would be useful to have wore 
©I .port unities to interact and conduct follow-up discussions on 
the implications of the institute presentations among teachers 
from similar grade levels. 

When ashed if the institute would result in individual 
instructional change, all responded yes, and several comments 
reflect that the institute provided them with an insight to find 
what the students are thinking and how to teach them about what 
they're learning. Another pervasive point was that Fellows had 
changed their own outlook on math, which would in turn be 
reflected in their classrooms. One participant said, "I've gained 
some insight on how I can ... coordinate cooperative Isarninq 
and independent work. " Another said, "One of my goals is to look 
into math as a way of thinking . . . Hook at) basic skills . . . 
the real stumbling blocks of a lot of kids. » Several participants 
noted specifically that a change in their teaching would be 
directly reflected in the students' learning. One participant 
commented that, "I know it is going to be fun for me. If it is 
fun for me the students are going to learn from it. " With regard 
to expanding these changes in the classroom, such comments as "I 
can use math in other areas throughout the day, - and "It has given 
me a lot of ideas for supplementing what I do in math" were 
cc anion. 

When asked if the institute would result in systemic 
instructional change, most participants did not see any radical 
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change coming from a single institute- They did, however-, see it 
as a step toward systemic change. One example of comments 
reflecting this belief is provided by the statement that "It's a 
step toward structural change, and "I don't believe that it is 
going to be a wholesale revolution, but there will be some 
change." A somewhat more enthusiastic respondent said ». . . 
rchangeJ is going to take a long time, but if we do a little bit 
here and . . . there, maybe eventually the whole curriculum will 
change. This is a step in the right direction." Several 
participants noted the need for change taking place in the 
framework. "I think the frameuork is the basic instrument of 
change . . . the workshop acts as the translator, » said one 
participant. Some doubt was expressed by one Fellow who said, "2 
don't know. Teaching is like a circle. You go through these 
different phases - - - I hope we're not changing just for the need 
of change. " 

The participants were asked what it would take for systemic 
change, and if it was needed at all. Eight responded that "yes", 
change was necessary, while two responded that it was not 
necessary. Thirteen did not provide a categorical response. The 
key to change, as cited by most participants, was support for 
follow-up services. A typical response was, "with the follow-up 
through the year, then you will be able to cultivate those seeds 
and pBrhaps institute some changes. - One participant observed 
that, "It depends on the P. R. with the districts and 
administrators. tSystemicJ change won't happmn unless we go from 
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here, we can't stop." Some participants suggested alternative 
methods for systemic change- One participant proposed that, "What 
we really need is a core of teachers building model math 
programs- - Another suggested that, "We as individuals have to be 
the stimulus that convinces administrators to provide the 
opportunities to our colleagues." The remaining comments also 
underscored the importance of the follow-up to the success of the 
Institute. 
Summary 

Responses to the Summer Institute were overwhelmingly 
positive. On the negative side, some concerns were expressed 
about the organization and pace of the initial week. There were 
also a few objections to being placed in the role of student, 
albeit others thought they gained a good deal of empathy for their 
own students from this experience. There was general consensus 
that whatever problems had been experienced during the initial 
stages of the Institute were soon cleared up. Most participants 
though the Institute staff had been flexible and responsive to 
suggestions and expressions of concern. It was especially 
interesting that some participants who initially felt overwhelmed 
and confused apparently came to feel that their initial 
frustration had been a necessary and growth-facilitating feature 
of the experience. 

One concern that seemed to remain for resolution in planning 
for future Institutes was an expressed need for more follow-up of 
activities. In reading the entire transcripts of the interviews 
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one gains more of an impression than the excerpts provided here 
may convey that there was a desire to bring more activities to 
some kind of closure. Participants expressed an appetite for 
analyses of how given topics or activities translate into specific 
teaching situations. 

There was a general consensus that Institutes such as the one 
they bad just completed merely provided an initial {but essential) 
step toward reform in mathematics instruction. There was some 
diversity in the degree to which Fellows agreed that reform was 
needed at all. No-one seemed prepared to return to their school 
and completely transform their program. There was general 
consensus that the possibilities for change brought to their 
attention during the Institute were overwhelming. Without 
exception, participants declared their individual intention to 
take selectively from the ideas with which they had been 
presented, and to implement them as their own sense of comfort and 
security, and their perception of the need for change permitted. 

Participants were forceful in their view that follow-up was 
essential if the Institute was to h*ve any lasting impact. They 
looked forward to the monthly meetings that would be held 
throughout the year. Beyond that, it was clear that 
administrative support would be vital to any attempt to 
disseminate what Fellows had learned through the Project to their 
col leagues. 

Approval of the homogeneous mix of participants from the 
entire K-1S spectrum was pervasive. Even t^ose few who would have 
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pmferred mor* work with teachers at their own level <these tended 
to be secondary teachers) acknowledged the value of the 
opportunity to interact with teachers from other instructional 
levels. More opport unit i»s for grade level meetings and for 
analysis of the application of various topics to specific 
classroom situations would probably satisfy the few concerns that 
were expressed. In general , participants were grateful for the 
opportunity to gain a better understanding of the problems 
encountered by teachers at levels above and below them, and to 
become familiar with those teachers' expectations. Many Fellows 
talked about the isolation of teachers, not cnly from teachers at 
other levels, but from other teachers in their own schools. The 
chance to brmak out of that isolation, and to form networks with 
teachwrs who shared their problems and interests was seen as a 
major benefit to be derived from the Project. 

Post-Institute Survey 
The California Mathematics Project Post-Institute Survey 
Form was used at the end of the Institute to obtain information on 
a variety of topics, ranging from participants' plans for sharing 
of ideas with colleagues during the school year, to specific 
suggestions for improvement. The free-response items covered much 
the same topics as were examined in the Monterey Bay Area 
Mathematics Project's own evaluation, and information relevant to 
these topics were incorporated into the previous section. This 
section examines participants' responses to a series of Likert 
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scale items that examined judgments of the degree to which the 
project increased or expanded the characteristic in question. 
Responses involved choosing from descriptors ranging from "Not at 
all" <1 point) to "A great deal" <5 points). Descriptive 
statistics for these responses are displayed in Table 8. 



Table 8 

Participant Perceptions of Self -Change 

Wean SD Win Max 

Please rate the extent to which the California Mathematics 
Project has increased or expanded your: 

a- knowledge or understanding of 
mathematics. 

b. repertoire of problem-solving 

strategies. 

c. awareness of resources for teaching 

mathemat ics. 

d. understanding of math curricula 

across grade levels. 

e. belief in the need for changes in 

math curricula. 

f. repertoire of techniques for 

teaching mathematics. 

g. standards for evaluating student 

performance in math. 

h. commitment to increasing minority 

and female participation in math. 

i. pride in teaching as a profession* 
j- familiarity with uses of micro- 
computers in math teaching. 

k. ability to develop inservice 

present at i ons. 
2. appreciation of process in 

learning. 



3.78 


.95 


5 


3 


3.87 


.83 


3 


5 


4.*_2 


-85 


2 




4. 30 


.70 


3 


5 


3.87 


1.08 


£ 


5 


4. 44 


.73 


3 


5 


2.61 


1.20 


i 


5 


3.50 


1. 10 


Z 


5 


3. 74 


1, 10 


1 


5 


3.30 


1.02 


1 


5 


3.44 


1-08 


1 


5 


4.i7 


. S3 


2 


5 
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These data indicate that participants considered themselves 
to have made important gains in almost all areas included in the 
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questionnaire. Perceptions of gains were especially strong with 
regard to an increased awareness of resources for teaching 
mathematics, understanding the math curricula across grade levels, 
enhancement of their repertoire of iachniques for teaching 
mathematics, and appreciation of process in learning. The one 
area of notable weakness was in increasing knowledge of standards 
for evaluating student performance in mathematics. 

Instructional Practices in Mathematics 
A questionnaire entitled "Survey of Instructional Practices 
in Mathematics- was developed in an attempt to assess the degree 
to which instructional practices advocated in the California 
Mathematics Framework were being implemented by teachers who 
participated in the project during 19S6-87 (Fellows), by a 
"Dissemination Group" of teachers who participated in training 
conducted by Fellows, and by a Comparison sample of local teachers 
who had neither direct nor indirect contact with the Monterey Bay 
Area Mathematics Project. In order to be relevant to teachers at 
all levels, matters of content were not addressed in the 
questionnaire. It was confined to instructional characteristics 
that should be applicable at all levels, as outlined in the 
"Delivery of Instruction" chapter of the Mathematics Framework 
(California State Department of Education, 1985). The intent was 
to test for the direct effects (statistical) of the program on ihe 
teaching practices of Fellows, and to search for dissemination 
effects that might be attributable to inservice workshops 
conducted by Fellows. 
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Subjects and Procedures 

7hs survey was distributed during late May and early June, 
1987. Copies were sent to all 1986-87 MBflWP Fellows. Fellows 
were asked to complete end return their own survey forms and to 
ask colleagues who had attended the inservice activities they had 
conducted to participate in the survey. fill respondents were 
assured that their replies would be anonymous. In addition, 
responses were solicited from mathematics teachers in one local 
high school and six elementary schools. One elementary school 
represented a small^ one-school district, and the remaining five 
were from the two large school districts in the county. A copy of 
the survey and the cover letter soliciting cooperation is 
displayed in Appendix B. 

The intent of the questionnaire was to identify instructional 
practices at a point sufficiently late in the year that all 
inservice had been completed- The timing was unfavorable because 
it coincided with the pressures of closing the school year and 
placed an undue burden on those teachers who, nevertheless, took 
the time to respond to the instrument. The return rate was less 
than desired, but reasonable in view of the timing. 

A total of 1J2 completed forms were received: 15 from 
Fellows, 27 from Dissemination teachers, and 80 from Comparison 
teachers. Ten additional teachers who returned survey forms did 
not provide the information required to identify them with one of 
these three groups. It should be noted that the training 
activities conducted by MBAMP Fellou* were often provided under 
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regular school or district inservice auspices without explicit 
identification of a relationship to the Monterey Bay Area 
Mathematics Project. Consequently, some teachers who attended 
mathematics inservice sessions that were planned or conducted by 
Fellows may not have associated the training they received with 
the Project. 

The format of the questionnaire was adapted from the self- 
perception scales developed by Hat-teir <1985, 198S). Each item 
consisted of two contrasting statements. For each item, subjects 
directed to select the statement that best represented their own 
teaching practices. They were then to mark a box indicating 
whether that statement was "Really tree for me" or "Sort » f true 
for we." Hmrtmir developed this format in her research on social 
competence to overcome some of the tendency of items in 
traditional self-report scales to elicit socially desirable 
responses. Harter has employed this format successfully in 
various scales designed for use with subjects ranging from early 
elementary through college age samples. 

Even with the guarantee of confidentiality and an emphasis on 
the importance of providing responses that represent actual 
teaching practices, the social desirability bias that besets all 
self -report instruments was not overcome completely. The social 
desirability problem is illustrated by an anecdote told by one of 
the Fellows during the last of the Project's monthly meetings for 
the year. When asked to complete the survey, one teacher's 
frustrated response was, "Am I supposed to fill this out the way 
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I know I should teach, or fill it out like 1 really teach and 
admit I'm a lousy teacher?" Nevertheless, the fact that responses 
displayed substantial variation gives us some assurance that 
social desirability tendencies did not overwhelm the ability of 
subjects to respond honestly. 

Analysis and Results 

Responses to each Framework item fall along a 4-point scale, 
with 1 representing the lowest and A the highest degree of 
congruence with practices advocated in the Framework- Items were 
summed for the main analyses, with the Framework Total Score 
forming the dependent variable- Me hypothesised that responses of 
WBflMP Fellows would manifest the highest overall congruence with 
the Framework, followed by those of the Dissemination group, with 
Comparison teachers having the lowest Framework congruence scores. 
We also wondered if differences in the level of teachinjj 
assignments (elementary, junior high or middle, high school) would 
influence the outcome. Interactions between group membership and 
teaching level were not hypothesized. In addition, we anticipated 
that Framework scores could be predicted by the total amount of 
time subjects had spent durin- the academic year participating 
inservice activities relating to mathematics. 

Table 9 presents the descriptive statistics on the total 
Framework sec r «s achieved by each group. The scores of the 
Dissemination Group and Comparisons were remarkably similar, while 
the mean of the Fellows group was 7.55 points greater than the 
Dissemination Group and surpassed the mean for Comparisons by S. £3 
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points. 

Descriptive statistics on Framework scores aggregated by 
teaching level are shown in Table 10. Elementary and junior 
high/middle school teachers had comparable scores, but the scores 

Table 9 

Descriptive Statistics for Mathematics Framework 



Group „ Mean 



SD 



MBflMP Fellows 15 76.00 10. 5£ 

Dissemination Bp 27 £8.45 7.54 

Comparison 60 57.77 9*76 



of high school teachers lagged 7. SB points behind those of middle 
school teachers. 
Table 10 

Descriptive Statistics for Framework Aggregated by Teaching Level 



Grou P a Wean 



SD 



Elementary 48 71.06 9.07 

Jr. High/Middle 10 71.33 11* 08 

High School 19 64.05 7^68 



To test for joint and individual influences of Sroup and 
Teaching Level on Framework scores, a series of hierarchical tests 
were conducted. This approach was chosen because of the 
nonorthogonal design created by differences in sample size amon S 
the three groups. The initial analysis employed the model 
FRAMEWORK dependent variable) = CONSTANT + GROUP + LEVEL + 
GROUP#L£VEL. The Group x Level interaction term did not achieve 
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significance, so the interaction component of the model was 
dropped for the next analysis- A 3 (Group) x 3 (Level) Analysis 
of Variance (omitting the interaction from the equation) revealed 
significant main effects for both Group CF » 3.664, <d_£ 2, £8), a < 
.033 and Level C£ - 4.879, <d_f 8,68), ft < .013. The multiple & 
for the joint influence of Group membership and teaching Level was 
.441 <g£ » .194) indicating that Group and Level accounted for 19 
percent of the variance in Framework scores. 

A follow-up t test comparing the Framework scores of Fellows 
with those of the closest adjacent group, the Dissemination 
teachers, was significant It = 2.316, td± 5,30), a = .0281. A 
similar contrast of Framework scores for Junior High and High 
School Teachers was marginally significant <t = £.004, df 25, a = 
.056). The analyses used only those cases <n m 73) for which all 
data were available on all variables. The effect of sample loss 
due to incomplete data on the descriptive statistics ranged from 
non-existent to negligible. The means and standard deviations for 
the 10 Fellows and 15 members of the Dissemination Group members 
included in this analysis were identical to those reported in 
Table 9. For the 41 Comparisons whose data were included in the 
analysis, the mean and standard deviation of 68.22 and 9.77, 
respectively, were nearly identical to the 67.77 and 9.76 of the 
larger sample. Thus, there appeared to be no systematic bias 
associated with instances of Missing data due to failure to 
respond to every item. 

Estimates of time spent in mathematics inservice activities 
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conducted by MBAMP Fellows and in comparable training provided by 
other sources were summed to form the independent variable for an 
analysis of the relation of time spent in matheraatics-ori anted 
inservice to Framework scores. Descriptive statistics on amount 
of inservice activities in which subjects had participated are 
presented in Table 11. Note that the values in the table 
represent ordinal data based on the categories provided in items 4 
and 5 of the survey (see Appendix B). The means suggest that, on 
the average, both MBAMP Fellows and Comparison teachers had been 
involved in slightly more than 4 to 6 hours of maths^tics 
inservice. Teachers in the Dissemination Group participated in 
approximately eight to ten hours of such training. 



Table 11 

Descriptive Statistics for Mathematics Inservice rime 
Grou P a Mean SD 



MBA MP Fe. lows 15 3.47 2. 85 

Dissemination Gp 27 5.5S 2~„ ££ 



Comparison &fb 3.18 



2. 24 



Hours of mathematics inservice was regressed on Groups, with 
MBAMP Fellows omitted from the analysis. Fellows were eliminated 
from this analysis because they were frequently involved in 
providing inservice training, and the question about participation 
was worded in such a way that participation as a trainee may have 
been confounded with participation as a trainer. For a sample of 
65 teachers for whom complete data were available, the multiple R 
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was -895 <b < .001), indicating that group membership accounted 
{statistically J for 8© percent of the variance in hours of 
participation in mathematics inservice {R* = .801). Although the 
non-random nature of the comparison group prohibits concluding 
that there was. a causal connection, the findings do suggest the 
possibility that the Project, via the inservice activities of its 
Fellows, may hf ve stimulated more professional development 
activities relating to mathematics instruction than is typical. 

Descriptive statistics for total hours of mathematics 
inservice are broken down by teaching Level in Table 1Z. The 
means indicate that elementary teachers participated in somewhat 
more than 4 to 6 hours of inservice work in mathematics, while 
secondary school teachers reported involvement in approximately 6 
to 8 hours. This finding seems reasonable, considering that 
secondary teachers generally have specialized assignments teaching 
mathematics whereas elementary teachers are responsible for a 
broader range of subjects which also may require some inservice 
participation. 

Table IB 

Descriptive Statistics for Mathematics Inservice Time Aggregated 
by Teaching Level 



Group a Mean 



SD 



Elmnmntary 72 3.60 £.73 

Jr. High/Middle 10 4.40 £* 99 

High School 23 4-00 £.37 
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degression analysis {with Fellows omitted) was also employed 
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to sxasains the relation of hours of i riser vice to scores on the 
Framework variable. The result fR - .195, a < .109) was not 
significant, although the trend was toward a positive relation 
between hours of mathematics inservice and Framework congruence. 

The main analyses employed the total score for Framework 
items. In most cases, it is unlikely that individual items 
pertaining to such a broad set of guidelines as the Framework 
would be sufficiently sensitive to detect group differences. 
Nevertheless, response frequencies by group were tabulated for 
exploratory purposes. Interestingly, Chi -square tests of the 
cross breaks identified three items that did suggest significant 
group differences. Wore frequently than the Comparison group, 
both the Dissemination Group <Chi-square = 9. 7S3, p. < .002) and 
Fellows fCbi-square - 10.115, a < .001) structured problem-solving 
experiences so students might encounter temporary frustrations in 
their problem-solving efforts. Teachers in the Comparison group 
were more likely to make an effort to provide problem-solving 
experiences that assure avoidance of frustration and assurance of 
success. The practice indicated by the Fellows and Dissemination 
teachers is congruent with the view that genuine problem-solving 
challenges will stimulate some frustration, albeit it temporary. 

Compared to Fellows, both Dissemination <Chi-square = 3.737, 
p. <.05) and Comparison fChi-square » a. 1JS, e < .004) groups 
reported less encouragement of varied approaches to problem- 
solving, including inventions. Dissemination and Comparison 
teachers more frequently provided students with a series of 

ERIC A2 47 



components or rules to be followed in problem solving. 

Fellows reported more frequent use than did Dissemination 
teachers of practices that place a high priority on helping 
sturients to identify global relations. This approach was 
contrasted with one in which students are taught to solve problems 
by identifying sequential steps to be followed. Fellows and 
Comparison teachers did not differ on this item. 

Considering the large number of comparisons involved in the 
exploratory analysis of response patterns, group differences by 
item should be scrutinized with caution. Any comparison yielding 
a probability value greater than .01 is suspect. Patterns of 
response (groups pooled/ are shown on the copy of the 
questionnaire in Appendix B. Item response data may play a useful 
role in subsequent efforts to improve the instrument. 
Summary 

The hypothesis of a diminishing degree of congruence wath the 
Mathematics Framework, from Fellows, to Dissemination Group 
teachers, to Comparison teachers, was only partially supported. 
The instructional practices reported by Fell ok - did exhibit a 
significantly higher degree of congruence with the Framework than 
did those of either of the other two groups, but Dissemination and 
Comparison teachers dio not differ on this dimension. Therefore, 
it appe*r% that the goal of promoting change among Fellows was 
accomplished with some degree of success. However, there was no 
evidence of a dissemination effect. We should also caution that 
data on differences between Fellows and the other groups must be 
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regarded with some discretion, because those who elected to become 
participants in the Project may have been more motivated and 
interested in instructional reform in mathematics than most 
teachers- 7t is important to remember, however, that most of the 
Fellows had little or no familiarity with the Mathematics 
Framework at the beginning of the Summer Institute. Moreover, as 
we reported in a previous section, much of what was presented 
during the project was perceived as new and interesting- The 
elementary teachers among the Fellows seemed especially to have 
gained a new perspective on mathematics instruction. It therefore 
seems likely that the observed effect is real. 

The question of whether teachers at different instructional 
levels display differential degrees of congruence with the 
Framework was answered in the affirmative. Elementary and junior 
high/middle school teachers reported a higher degree of congruence 
with the Framework than did high school teachers. Acting jointly, 
teaching Level and Grouo membership were strong predictors of 
Framework scores. 

Dissemination Group teachers participated in more mathematics 
inservice training than did comparison teachers. Thus, the 
Project goal of promoting professional development in mathematics 
education may have achieved some success. Nonetheless, the 
analyses failed to establish a relationship between amount of 
inservice activity in mathematics and congruence of instructional 
practices with the Framework. This finding should be considered 
in perspective. Whereas the size of the between-groups 
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differences in mathematics inservice <e.g., Fellows versus non- 
F*12ows, Elementary versus Secondary) are probably substantial 
when considered as a proportion of all inservice in which teachers 
participate during an academic year, the amount of time is 
infinitesimal when considered in the light of the extremely broad 
scope of the Framework. We will examine this issue further in the 
conclusion. 



Year— End Interview 
Project participants were interviewed by telephone at the end 
of the academic year. The results for each question are presented 
here. The interview schedule is presented in Appendix C. Item 
content is summarized for the presentation below. The first item 
inquired whether Fellows had participated in other (additional to 
MBAMP activities) professional development pertaining to 
mathematics during the past year. The vast majority {17 of the 19 
responding) indicated they had participated in additional 
professional development work specific to mathematics teaching. 
Table 13 presents the pattern of responses, broken down by 
teaching level. 

Those participants who answered »yes M to this question were 
asked t,-> compare their participation in such activities to the 
previous year. Specifically, they were asked if their 
participation has been considerably more than last year, more than 
last year, about the same as last year, less than last year, or 
considerably less than last year. Of the 17 responding, four 
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Table 13 

Participation in Professional Development in Addition to MBAMP 



Teaching Level Yes No. TOTAL 



Primary 3 

Intermediate 4 

Middle School 5 

High School 5 

TOTAL 17 



reported considerably greater participation, 8 reported greater 
participation, 4 reported no change, and 1 reported less 
participation than last year. These results are presented by 
teaching level in Table 14. 

Table 14 

Changes in Professional Development Participation 



0 
2 

1 

0 



3 
5 
£ 
5 



Participation 



Teaching Considerably Considerably 
Lgvel greater Greater Same Less Less 

Primary 0 3 0 0 0 



High School 1 g j j 

TOTAL 4 8 4 1 



0 



Intermediate 2 2 0 0 

Middle School 1 13 0 0 

0 



0 



ion 



The "Considerably greater" and "Greater" participate 
categories were pooled, as were the "Less" and "Considerably less" 
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categories, for further analysis- « Cbi-square test with yates 
correction for continuity indicated that significantly more 
participants reported an increase in professional development 
pertaining to mathematics compared to those who reported no change 
or a decrease in such activities <Chi-squar» « S.3i, E * .009). 
Examples of the activities in which participation was reported 
fwith the number participating in them indicated in parentheses) 
were school district inservice training <7) , private workshops 
f5), workshops sponsored by organizations participation on 

the County Curriculum Council, or other county involvement (8), 
contacting other teachers outside of own district (5), curriculum 
writing or other leadership role at school <8). 

Subjects were then asked if they had planned and presented 
any mathematics oriented inservice activities or workshops for 
others during the academic year. Fourteen ).ad participated in 
such dissemination activities, while five had not. Of those who 
had conducted dissemination sessions, three were primary teachers, 
three taught upper elementary grades, five worked in middle 
schools, and three were high school teachers. A follow-up 
question determined the total number of such activities for each 
individual who participated. Collectively, they accounted for the 
presentation of a total of 31 workshops or inservice meetings, 
with participation being quite evenly distributed across teaching 
levels. Subjects were also asked to report the total number of 
teachers who attended the training sessions. The number of 
teachers participating in these sessions totaled 618. 
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As a means of identifying more informal dissemination 
influences, MBAMP participants were asfced if they had been 
approached by colleagues for suggestions relating to curriculum 
and instruction in mathematics- Eighteen of the 19 who responded 
reported they had received such inquiries. Subjects were then 
asked to estimate whether such contacts had been more or less 
frequent than during the previous year. Responses to a 5-point 
scale are displayed in Table 15. 
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Table 15 

Frequency of Requests by Colleagues for Suggest i 



ons 



Teaching 
Level 



Consi der abl y More 
More Freqn* t 

Frequent 



Part i ci pat i on 
Same 



Less 
Freqn f t 



Cons i der^ab 1 y 
Less 
Frequent 



Primary 


1 


0 


i 


0 


0 


Intermediate 


2 


1 


3 


0 


0 


Middle School 


2 


4 


0 


0 


0 


High School 


1 


3 


1 


0 


0 


TOTAL 


S 


8 


4 


0 


0 



Data for levels and categories ^Considerably More Frequent + 
More Frequent and Con%idmrably Less Frequent + Less Frequent were 
collapsed for purposes of conducting a Chi-square test to 
determine if the apparent increase in contacts for consultation 
was statistically significant. The Chi-square <14.79, df 2, g_ < 
.001), with Vates correction for continuity, indicated that the 
increase in such requests was substantially more frequent than 
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might be expected on the basis of chance. 

When asked if they had changed their teaching of mathematics 
in any way as a result of participation in the Monterey Bay Area 
Mathematics Project, seventeen of a total of eighteen responded in 
the affirmative. Participants were then asked to give examples of 
ways in which their teaching of mathematics had changed as a 
result of the Project. Seventeen participants gave examples of 
changes in their mathematics that were attributable to the 
Project. These responses were then categorized and the number of 
participar^s mentioning each category tallied. Thirteen reported 
that they had taught a broader range of skills than formerly. 
This category was especially prominent among the middle school 
teachers, where 6 gave responses that fell into this category. 
The use of cooperative groups had been adopted by 7 teachers. Of 
these, 2 represented middle schools and three were high school 
teachers. The fact that only two elementary teachers reported the 
adoption of cooperative groups may reflect the fact that 
cooperative learning groups are already used more frequently in 
elementary than in secondary schools, and/or the fact that several 
inservice activities on cooperative learning were conducted by 
various agencies in the Monterey Bay region during the past year. 
Most of the participants in these workshops were elementary 
teachers, so it may not have been possible for elementary 
participants to attribute any cooperative learning strategies they 
may have adopted solely to the Project. 

Two participants reported using more projects iincluding 
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computers and journals) in their teaching. The adoption of 
manipuiatives as an instructional medium was reported by 8 
participants. Broken down by teaching level, those reporting this 
change were: hi^h school teachers = J, middle school = 2, uppsr- 
grade elementary = 4, and primary = 3. Four participants reported 
teaching more advanced concepts, such as algebra and georoetry- 
These responses were evenly split between elementary and Middle 
school teachers. 

Finally, seven respondents reported changes in attitudes 
regarding the use of resources, whic'> included textbooks and 
parents. Such changes were reported by teachers at aJJ levels 
except high school. It must be recognized that the changes 
reported here reflect only those practices spontaneously mentioned 
during the telephone interview. The fact that a particular 
intervi-wee did not mention a given practice does not necessarily 
mean that person did not adopt the change. Nevertheless, the 
responses appear to reveal a general pattern of the kinds of 
changes these teachers would attribute to thsir participation in 
the Program. 

Participants were then asked if there were changes they had 
hoped to make, but couldn't. Fifteen of the eighteen who 
responded said H yes, " with the affirmative responses being 
proportionally distributed across teaching levels. When asked 
what factors prevented them from making changes they had hoped to, 
four cited a lack of funds, while an additional seven mentioned 
o*:her barriors relating to unavailability of materials, computers, 

50 



and so on. Only one of the 17 who responded saw an unsupportive 
administration as an impediment to the changes they would have 
liked to implement. 

Eight teachers perceived class sire and limited facilities to 
constitute barrier, to change, while lack of time was specified by 
5 of those who provided examplss. of barriers to change. Four 
individuals cited deficiencies in student ability or motivation as 
factors that inhibited the adoption of practices they would like 
to try. Five participants mentioned skepticism o ; the part of 
peers or administrators who wanted proof that the innovative 
practices would produce results as the reason for failing to 
implement practices they would have liked to. Such insistence on 
"proof was cited most frequently by middle school teachers. 
Three of the 5 instances were reported at this level, with one 
instance each at the primary and upper elementary levels. 

Given that a goal of the Project was for participants to 
communicate new curricula and instructional practices in 
mathematics to others, participants were asked if their level of 
comfort in leading discussions of mathematics with peers, 
administrators, or parents had increased or decreased. The 
response mode consisted of a 5-point scale with categories ranging 
from "Much more comfortable" to "Much less comfortable". The 
results, by level, are displayed in Table IB. 

Data were pooled by level and category <More, Same, Less) for 
purposes of examining changes in comfort level by means of a Chi- 
square Test. The Cbi-square <with Yates correction for 
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continuity) of 24.0 (d£ 2, ft < .001) indicates solid achievement 
of the goal of helping participants to feel more comfortable in 
coramuni eating instructional practices in mathematics to 
colleagues, administrators, and parents. 
Table 16 

Expressions of Comfort Communicating About Mathematics Instruction 
to Others 



Teaching 




Participation 






Consi der abl y 
More 
Comfortable 


More 
Cowf r» t 


Same Less 

Comfr' t 


Considerably 

Less 
Comfortable 


Primary 


2 


1 


0 


0 


0 


Intermediate 


2 


3 


0 


0 


0 


Middle School 


2 


3 


1 


0 


0 


High School 


0 


4 


I 


0 


0 


TOTAL 


6 


11 


2 


0 


0 
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In order to determine the post-Project level of involvement 
in professional mathematics education associations, participants 
were asked if they were members of national, state or local 
associations of mathematics educators, and whether they 
participated in the Meetings of these organizations. The results 
are presented in Table 17. 

These data are not strictly comparable to those gathered at 
the beginning of the 1986 Summer Institute. There is no assurance 
that the same subset of participants responded on each of tb* two 
occasions, and rather than inquiring about actual participation 
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during a given time period, as was done for the present data, the 
earlier survey asked a more general question about whether 
individuals participated often, occasionally, or never, in these 
organizations. With these limitations in mind, a comparison of 

Table 17 

Membership and Participation in Mathematics Education Associations 



Type 
Activity 



NCTM 



CMC 



L/RMfl 



Member 


Yes 
A 


No 
15 


Yes 
8 


No 
11 


Yes 
5 


Mo 
1A 


Attend Mtg's 
or Conf f s 


Yes 
A 


Mo 
15 


Yes 
6 


Mo 
13 


Yes 
5 


Mo 
1A 



the present data with those presented earlier gives no reason to 
believe that participation in the Program has led to increased 
membership or participation at either the national or state 
levels. The raw frequencies, however, suggest a trend toward 
increased membership and participation in local and/or regional 
mathematics associations, since 5 of those responding to the year- 
end interview reported membership in such associations, compared 
with two at the time of the o»rlier survey. Similarly, 5 
individuals now report having participated in meetings or 
conferences of local or regional organizations during the year of 
their involvement in the Monterey Bay Area Mathematics Project, 
compared to 2 who previously reported ever having participated in 
such activities. However, Chi-squ*re tests of contingency tables 
for pre and post Project reports of membership and participation 
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in local and regional mathematics associations indicated that the 
trends did not achieve significance. 

The final question asked "Do you have any final comments to 
offer that would be helpful to the evaluation of the project?" A 
number of responses were unique to individual respondents whereas 
others fell into categories that expressed the views of a number 
of individuals. The following list summarizes all response 
categories and indicates the frequency of comments or suggestions 
falling into each: 

1- Learned about the Framework 3 

£. Learned about textbooks j 

3. Wanted more solid math £> 

4. Loved it. Would recommend it. jj 
5- More opportunity for same grade level together 3 
6. Enjoyed diverse backgrounds & levels of teachers 4 
7- Involve principals and parents more 5 

8, Follow-up (monthly meetings) was very important 7 

9. Wanted more evaluation <esp. mid-year) 3 
10. Wanted more structure in monthly meetings 7 
11- Encouraged indiv- to get involved at larger level 3 
12. Enjoyed a specific topic <e. g. f logic) 3 
13- Would have liked more respect as a professional 1 

14. Made math fun/enjoyable q 
15- Too much matmrial covered not in useful form 4 

15. flU participants should have partner from same school 3 
* 7 - Learned a lot of math- HmlpBd me pass CBE3T 4 
18* Wanted to learn how to teach math, not to enrich it 4 

Summary 

Results of the telephone interview provided evidence of 
movement in the direction of several of the Project goals. One of 
thesfc goals is that of encouraging Fellows to engage in acti\ bies 
that would enable them to serve as leaders in mathematics 
education in their schools and districts. Evidence of progress 
toward this aspiration seems quite strong. Fellows participated 
in many professional development activities that were relevant to 
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mathematics instruction, but independent of the on-going ventures 
of the Monterey Bay Area Mathematics Project. This participation 
represented an increase over what Fellows had done prior to their 
association with the Project. It also Appeared that there may be 
a trend toward increased m*wbmr*hip and participation in local and 
regional mathematics education associations, although i .- there is 
a trend it is not yet significant. If membership in national and 
state professional associations of mathematics educators is a 
valid unobtrusive index of interest in professional development as 
mathematics educators, Project aspirations in this regard fall 
well short of realization. 

Fellows do appear to be assuming leadership roles, and to be 
contributing to the dissemination of practices intended to 
contribute to reform in mathematics education. Ninety-four 
percent of them reported that they now feel more comfortable 
leading discussions of curricular and instructional issues in 
mathematics than they did prior to participation in the Project. 
The majority actually did participate in dissemination activities. 
Their dissemination ventures resulted in at least 31 inserviee 
sessions, reaching an estimated £00 or more teachers. 
Furthermore, Fallows were approached more frequently by colleagues 
for informal suggestions about mathematics curriculum and 
instruction than had been the case prior to participation in the 
Project. 

The majority <94X> reported that they had made changes in 
their own teaching of mathematics, and many ffl3*> would have made 
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wore changes had it not been for factors preventing it. The most 
frequently mentioned bmrriarm to change were a lack of funds, 
materials, and equipment. Class size and limited facilities were 
also perceived as obstructions. Lack of administrative support 
was not specifically identified as a problttm (with 1 exception), 
but several Fellows cited administrative and peer skepticism about 
the efficacy of innovative practices as an impediment to 
implementation. Viewed in the context of the discussion that took 
place at the last of the monthly meetings for this group of 
Fellows, it seems likely that standardized testing contributes to 
this concern. Many Fellows were apprehensivB about the 
possibility that the standardized achievement scores of their 
students would suffer if they spent too much time in activities 
they viewed as valuable, but which might not be reflected on the 
tests. 

It is also instructive to examine the responses to the 
qanmrml invitation for suggestions that might be useful to the 
evaluation of the project. we should brar in mind that just 
because a Fellows did not come forth with a given comment 
spontaneously does not mean they would not (or would, for that 
matter) have agreed with it had it been put to them directly. 
With that in mind it is noteworthy that the majority of the 
Fellows voiced a strong positive assessment of the Project, saying 
they loved it, would recommend it to others, and so on. There was 
also a strong demonstration of support for the monthly meetings, 
although several Fellows also suggested more structure for these 
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gatherings. A number of those who responded also recommended 
greater involvement of parents and principals. 

Discussion 

The California Mathematics Project was established with the 
intent of inducing reform in the teaching of mathematics. The 
ultimate target, of course, is enhancement of mathematical 
competence among all students in the pi-blic schools of California. 
The program places special emphasis on groups of students who have 
not perceived mathematics as rslevant to their lives, and who have 
tended to exercise their option to drop out of the mathematics 
curriculum prematurely. 

To accomplish this ultimate purpose requires that mathematics 
teachers be better prepared to guide the learning of their 
students. They especially need the knowledge and skills required 
to nurture the development of higher order mathematical reasoning 
and problem solving abilities, in contrast to the emphasis on 
computation that presently dominates both curriculum and 
assessment. The task of providing pre-service education for 
teachers consistent with these aims is left to other 
initiatives. The California Mathematics Project focuses its 
resources on the tens of thousands of teachers who are already in 
the field. 

The resources available to tne Project could never provide 
direct tracing for all of these teachers, even if there were an 
existing mechanism by which it might be accomplished. The 
strategy, therefore, is to select teachers with potential to 
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influence the instructional practices of their peers, provide 
direct and follow-up training for them through regional projects, 
and encourage the* to disseminate what they have learned to their 
peers. Because it is difficult to be a lone innovator in a 
school, local projects are encouraged to admit teams of teachers 
who represent their schools. 

Our evaluation parallels the sequence of events implied by 
this strategy, concentrating on the earlier links in the 
hypothetically causal chain of events. Summer Institute in 19B& 
provided the base from which the Monterey Bay Area site of the 
California Mathematics Project got underway. Therefore, the first 
major component of the evaluation plan centered on the operations 
and outcomes of the Institute. Formative evaluation data (e.g., 
how interesting, useful, and cleanly presented were the ideas and 
activities> were considered critical because teachers could not be 
expected to implement ideas they found uninteresting, confusing, 
or esoteric. 

Overall, data from the daily evaluations demonstrated a very 
positive, response by the vast majority of the participants. More 
importantly, this information enablBd the Institute staff to 
monitor assessments of activities on a daily basis, and to adjust 
their plans accordingly. 

The exit interview and post-Institute survey both confirmed 
the overall positive assessment of the summer effort. 
Participants clearly thought they had gained valuable skills, 
insights, and competencies. Concerns that did arise tended to be 
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concentrated during the early days of the Institute, and the staff 
was generally commended for its responsiveness and flexibility in 
dealing with these problems. 

Most Fellows were optimistic that the Program would influence 
change in mathematics instruction, but they expected the 
transformation to be evolutionary rather than revolutionary- Each 
Fellow anticipated making changes selectively. They also felt 
strongly that continuing support and follow-up in the form of the 
projected monthly meetings would be essential. 

There was broad-based approval of the heterogeneous 
composition of the Institute participant group. Wide variations 
in mathematics background and teaching assignments did create some 
problems, but Fellows suggested that these could be ameliorated by 
providing more follow-up and analysis of possible applications to 
specific grade levels or situations. This recommendation is 
consonant with the counsel offered by evaluators of other 
instructional change efforts. Prospects for success seem to be 
enhanced when participants are provided adequate time, during 
training, to plan how they will use what they have learned, icf., 
bobbins, 19B5). 

Of the topics examined in the post -Inst i tut e survey, the one 
that seemed to call for increased attention in subsequent efforts 
was that of evaluating student performance in mathematics. 

Telephone interviews conducted at the end of the year 
provided additional evidence of Project effects. The level of 
participation by Fellows in professional development activities 
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related to mathematics increased, above and beyond the continuing 
Project activities in which they participated. They cane to feel 
wore comfortable leading discussions of mathematics education with 
peer*, administrators, and parents. They exercised leadership in 
mathematics education by conducting inservice sessions for other 
teachers, and their colleagues looked to them more often for 
informal suggestions on math instruction. They also made changes 
in their own teaching of mathematics, based on project 
experiences. 

During the exit interviews at the end of the Summer 
Institute, one Fellow made the perceptive observation that . . 
thr» framework is the basic instrument of change . . . the workshop 
acts as the translator." A similar assumption supports the logic 
behind our survey of instructional practices in mathematics. The 
analysis of data from that survey disclosed the self-described 
instructional practices of Fellows to be more congruent with the 
Framework than those of either of the other two groups. The 
practices of Dissemination teachers, however, were no more 
consonant with the Framework than those of Comparison teachers, 
resulting in the rejection of the dissemination effect hypothesis. 
The analysis also failed to detect an association between 
Framework scores and the amount of time Dissemination and Control 
teachers were occupied in mathematics inservice. 

Whereas Fellows did indicate that some of their instructional 
practices had changed as a result of Project training, most made 
fewer changes than they had hoped to. Deficiencies in funds, 
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materials, equipment, and appropriate instructional facilities 
stood as impediments to change. So also did class size and time 
limitations- Serious though these barriers are, they may be more 
amenable to change than the skepticism of peers and administrators 
who ask for proof of the efficacy of practices that would be 
viewed as "innovations." Such skepticism works in tandem with 
apprehension about possible effects on standardized test results 
that may attend deviations from traditional practices. It seems 
quite clear that teachers would feel freer to implement the ideas 
they have acquired in the Project if achievement assessment were 
modified to reflect practices advocated in the Framework more 
adequately. P step in this direction would be to follow the 
advise of those Fellows who suggested increased involvement of 
administrators and parents in the Project. 

The failure to detect a dissemination effect does not 
necessarily mean there was none. Quito possibly the survey 
instrument was not sufficiently sensitive to ascertain an effect. 
Nevertheless, we have no evidence that there was an effect. That 
f^ct may give cause for a reexamination of the multiplier 
strategy, whereby Project participants are expected to pass the 
knowledge and skills gained through their own training on to 
colleagues. The principle may be quite viable for relatively 
circumscribed goals, but the scale of change envisaged by the 
California Mathematics Project's creators is very extensive. The 
multiplier principle should work if objectives are defined with 
sufficient clarity, and if there ir» a well articulated plan to 
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achieve those aims. We do not question the quality of the 
individual inservice meetings conducted by Fellows. But, when 
considered in their totality, the efforts seem fragmented and 
somewhat haphazard. fl more coherent plan, negotiated with school 
administrators, may be needed to assist Fellows in meeting 
dissemination expectations. 

The strategy of encouraging Fellows to work for change in 
their schools, and especially the emphasis on encouraging 
participation in the Project by teams from schools, is consistent 
with conclusions from the literature on educational change. This 
literature suggests that reform is most successful when local 
school sites serve as the locus of change. But this same 
literature also emphasizes the importance of 1) teacher 
involvement in innovation and decision-making, S) a problem- 
solving orientation at the school site level, and 3) a focus on 
problems that teachers consider important to their day-to-day 
routine fBentzen etr al., 1974; Berman & McLaughlin, 1973-78; 
Goodlad, 1975,; Williams & Cannings, 1981). These conclusions 
suggest that it may be important to assist participants in 
developing strategies whereby the they may work with their 
colleagues to adapt Project activities and content tc perceived 
needs at the school site. Such an approach may be needed to help 
teachers at individual school sites develop a sense of ownership 
of reforms. 
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APPENDIX A 



Monterey Bay Area Mathematics Project 
Institute Evaluation 



Day Six: Tuesday, July 15 Name: 



tooS I™ £SL? eneral ira Pf ess f°ns.°f each of the following 
r££i f today's program by circling the number that best 
represents your perception. 



a'. Function Machines 

Interesting 
Useful 

Clear <r 5 




3 
3 
3 



b. Cooperative Learning/Minority Res. 



Interesting 

Useful 

Clear 

c. Stations 




4 
4 
4 



Interesting 
Useful 
Productive 



5 
5 
5 



d. 



Great Shapes Contest 



Interesting . 

Usefui 

Clear 



J5_ 
5 
5 



4 



3 
3 
3 



3 
3 
3 



3 
3 
3 



2 
2 

2 



2 
2 
2 



2 
2 
2 



2 
2 
2 



1 Uninteresting 
1 Not useful 
1 Unclear 



1 Uninteresting 
1 Not useful 
1 Unclear 



1 Uninteresting 
1 Not useful 
1 Unproductive 



1 Uninteresting 
1 Not useful 
1 Unclear 



II. 



*J ease respond to each of the following items by circling 

the letter(s) that best represent(s) your opinion. 

SA = Strongly Agree 

A = Agree 

NO = No Opinion 

D » Disagree 

SD = Strongly Disagree 



1. 



This topic/activity is applicable to 

a. Function Macxiines 

b. Cooperative Learning/Minority 

c. Stations 

d. Great Shapes Contest 



my teaching situation. 
SA A NO D SD 
SA G\_ NO D SD 
<A~ NO D SD 
SA A NO D SD 
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Next year I will probably try new instructional practices 
based on this topic/activity. 



a. Function Machines 

b. Cooperative Learning/Minority 

c. Stations 



NO D SD 
NO D SD 

d. Great Shapes Contest {jfrs Jg g Jg 




Most teachers in my school are already familiar with the 
instructional implications of this topic/activity. 

a. Function Machines Csa^ A no n cn 

c* S?ations iVS Learnin ^ Mino "ty Na~ Qa vq g Jg 
d. Great Shapes contest £ £ C |° gg 

Most teachers in my school are already using instructional 

practices based on the ideas this topic/activity dealt 

a. Function Machines <Tsa^ A wn n -en 

c* S?at?c-s 1Ve Learnin ?/ Mino ^ty ^SA-Ctr Z g Jg 
d. Great Shapes contest g J <S <r{^ SD 
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APPENDIX B 
UNIVERSITY OF CALIFORNIA, SANTA CRUZ 



BERKELEY . DAVIS ♦ IRVINE » LOS ANGELES » RIVERSIDE • SAN DffiCO • SAN FRANCISCO 




SANTA BARBARA • SANTA CRUZ 



Merrill College 



Santa Cruz, California 95064 



May 14, 1987 



Dear Colleague: 



S JSTI. « ^ V VeTy u U I y nme ° f year for y° u ' but we h °P e y° u will take a few 
imnu.es o complete the attached questionnaire. Your responses will be completely confidential 
The analysis of data will use only aggregated data, and no individual, school district, or 

* ^ wm be used in planning fu'ture 



mathematics institutes. 

The first section of the questionnaire requests background information. Part II asks you to reflect 
on your teaching practices in mathematics, and to indicate which of two contrasting practices is 
most like your own. Separate instructions are provided for Part II. 

We greatly appreciate your cooperation in Ms effort. If you would like to receive a summary of 
the results of smvey just contact either of us at UCSC. Ron's telephone number is 429-4740 
(message, 429-2855) and Ed's is 429-2423 (message 429-2085). 

Sincerely, 

Ronald W. Henderson Edward M. Landesman 
Professor of Education Professor of Mathematics 
and Psychology 
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Survey of Instructional Practices in Mathematics 



Parti 

(1) School Type: (Check the one that applies) 

Hementary Middle Junior High Kigh 

(2) What grade(s) do you teach? (Check all that apply) 



K 



7 8 9 10 11 12 

(3) Did you attend the Monterey Bay Area Math Project (MB AMP) institute during the summer, 1986? 
No Yes 



(If your answer is "yes," skip to question 5.) 

(4) During the 1986-87 academic year, did you participate in any math in-service meetings or 
workshops conducted by teachers who attended the MBAMP Institute last summer? 

No " Yes 



If you answered "yes" to question 4, please mark the appropriate box to indicate the approximate 
time spent in all mathematics in-service work led or organized by MBAMP tea hers. 

less than two hours two to four hours 

four to six hours six to eight hours 

eight to ten hours over ten hours 



(5) Please estimate the total time you were involved during the 1986-87 in-service meetings or 
workshops that were not conducted by past participants in the Monterey Bay Area Mathematics 
Project 

less than two hours two to four hours 

four to six hours six to eight hours 



eight to ten hours over ten hours 
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Partn 



The Mowing items contain statements that describe instructional practices. Each item contains two 
contrasting statements, separated by the word BUT. A pair of boxes appears at each end of each item. 
These boxes represent the phrases that appear above them: "Really True for Me," and "Sort of True for 
Me." The statements arc not intended to identify opposite or opposing practices. Rather, they may be 
thought of as representing approaches that vary along a continuum. Most teachers use some of each 
approach, but practices do vary on the basis of personal preference, educational philosophy, and 
competing pressures for time and resources. 

Read each of the statements for each item and decide which of them is the best description of you. Most 
people will find that both statements are true to some extent, but pick the ONE that seems to describe 
your practices best, even if the choice is difficult Then, mark an "X" in one of the boxes beside that 
statement If the statement describes your approach quite well, mark the box that indicates "Really Tnie 
for Me." If the statement is a somewhat less accurate description of your practices, marie the "Sort of 
Tnie for Me" box. Mark only ONE box for each item. 

Your responses to these items win be held strictly confidential. 



Look at the Sample Sentence below. Then mark the appropriate box for the statement that describes your 
practices best Only one box is to be marked for each item, even :f the choice is very difficult. 

Sample Sentence: 



♦ 



♦ 



♦ 



♦ 



Really True Sort of True 
For Me For Me 



Sort of True Really True 
For Me For Me 



□ 



□ 



Some math 
teachers 
emphasize 
the practical 
applications 



BUT 



Other math 
teachers 



□ 



rarely 



mention the 
practical 



of 

mathematics. 



uses of 
mathematics. 
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Really True 
For Me 



□ 



Sort of True 
For Me 



(29) 



□ 



Some teachers spend very little time 
demonstrating relationships among 
concepts and skills from different 
strands of the curriculum framework. 



BUT 



Other teachers spend a great amount of 
lime providing activities designed to 
demonstrate relationships among 
concepts and skills from different 
strands of the curriculum framework. 



Sort of True 
For Me 



□ 



Really True 
For Me 



□ 



(7D 



□ 



(26) 



□ 



Given the pressures to cover a wide 
range of topics, some teachers allocate 
little classroom lime to problem-solving 
activities. 



BUT 



Other teachers allocate a substantial 
amount of instructional time to 
probJom-solving activities. 



□ □ 

(76) 



□ 



(82) 



| — | Some teachers provide parents with 

' — ' information on matters such as 

expectations regarding student learning 
and homework, current student status, 
and things parents can do to promote 
student progress. 



BUT 



Other teachers communicate with 
parents primarily by means of report 
card marks. 



□ □ 

Uo) 



□ 



(46) 



□ 



Some teachers encourage students to 
solve problems by following a 
sequential set of steps. 



BUT 



Other teachers encourage students to 
conjecture about the nature of a 
problem solution before working on it 
in detail. 



□ □ 

(52) 



□ 



(19) 



□ 



Some teachers confine math for low 
functioning students primarily to 
computational skills. 



BUT 



Other teachers provide a comprehensive 
program, across the strands, for low 
functioning math students. 



□ □ 

(81) 



□ 



ERIC 



(92) 



I — i Some teachers provide cooperative 

learning activities for students in math 
classes. 



BUT 



Other teachers question the value of 
cooperative learning activities. 



□ 



(8) 



Numerals in parentheses indicate raw frequency of teachers who selected the statement. 
Data for "Really true for me" and "Sort of true for me" were pooled. 
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□ 



Really True SortofVme 
For Me For Me 

□ □ 

163) 



□ □ 



□ □ 



Some teachers feel it makes math more 
interesting to vary, to some extent, the 
terms they use for math skills and 
concepts. 



i— I I — 1 Some teachers encourage students to 

I — I I — I pose mathematical questions of their 

(84) own. 



Some teachers assign homework 
designed to involve students' families in 



(43) their homework. 

1— 1 I — I Some teachers ask students questions 

*— ' I— ' that require them to explain how they 

(98) solved a problem. 



pi I — I Some teachers encourage students to 

LJ I — I invent problems of their own, based on 

quantitative information made available 
(57) to them. 



Some teachers concentrate their 
attention on teaching a relatively small 



( 68 ) number of generalizations. 
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Sort of True Really True 

For Me For Me 

Other teachers use mathematical terms 1 — 1 p 1 

j n a strictly consistent fashion. ' — ' *—» 

(38) 

Other teachers rarely encourage 1 — 1 1 — 1 

D ^ T students to pose their own mathematical *— ' I— * 

questions. (18) 

Other teachers prefer homework 1 — 1 pi 

BUT alignments that reamre stnrienfc tn Hn ' — ■ I — I 
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assignments that require students to do 
their own work. 



whether students get the right answer 
than in !he thinking processes they used 
to reach a solution. 



published materials. 



(52) 



Other teachers are more interested in 1 — 1 1 — 1 
CUT whether students ffet the riffht answer ' — ' I — I 



(3) 



Other teachers rely mostly on teacher- 1 — 1 1 — 1 
constructed problems or problems from ' — ' I— J 



(42) 



Other teachers focus more of their 1 — 1 1 — 1 
BUT effon on teaching a fairly large number ' — ' ' — ' 
of rules. 



(24) 
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Really True Sort of True 
For Me For Me 



□ □ 
(45) 



Some teachers reinforce previously 
learned concepts and skills by providing 
periodic review for their students. 



□ □ 



Some teachers structure problem- 
solving experiences for students in a 
way that provides avoidance of 
(53) frustration and assurance of success. 



Some teachers provide students with a 
scries of components or rules to be 



□ □ 

(32) followed in problem-solving. 

□ □ 



Some teachers use concrete materials 
with students who arc having trouble 
dealing with abstract concepts and 
(35) symbols. 



Some teachers rely primarily on one or 
two methods of instruction, such as 
(27) whole-group instruction and scatwork. 



□ □ 



□ □ 



Some teachers confine their assessment 
activities mostly to testing for progress 
and/or standardized achievement 
(21) testing. 
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S ort of True Really True 
For Me For Me 



Other teachers encourage the use of 
varied approaches to problem-solving, 



weaknesses throughout the year. 



□ □ 



Othvf teachers reinforce concepts and 
BUT skills by providing new contexts and 

settings for the application of (52) 
previously learned concepts and skills. 



Otfier teachers structure problem- 1— 1 r-i 

solving experiences so students are ' — ■ 
likely to encounter temporary 

frustrations in their problem-solving (45) 
efforts. 



□ □ 



including student inventions. (65) 



Other teachers provide some concrete 1 — 1 1 — 1 

manipulative experiences even for those ' — ' ' — ' 
students who function quite well at the 

abstract level. ( 60 ) 



Other teachc s use a wide variety of 1 — 1 t — 1 
B1JT instructional methods. * ' 



(74) 



Other teachers analyze student 1 — 1 1 — 1 
responses to identify students needs and 



(79) 



Really True Sort of True 
For Me For Me 



r—j r-j Some teachers take special care to make 

' — ' \ sure ^ eir slu( k nls acquire appropriate 

1 68 ) mathematics vocabulary. 



p | pi Some teachers ask questions that mostly 

for>\ require studenls to recall facls and 

*3o; skii ] S# 



p-i p-| Some teachers help studenls learn to 

*— 1 / a \ 50176 P roblems bv identifying 

V o 4 J sequential steps to be followed. 



□ □ 



□ □ 



Some teachers make extensive use of 
concrete materials and visual aids to 



/ A - \ support their studenls* learning of 

' * * ' mathematical vocabulary. 



I — | pi Some teachers want studenls to respond 

1 — 1 ( 1 ) quickly to questions posed to the class. 



Some teachers reinforce students for 
their problem-solving efforts, even if 
(95) they get the answers wrong. 
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Sort of True Really True 
For Me For Me 

Other teachers are less concerned that i— i i — ■ 
DllT studenls learn the formal terminology «— ' L-J 

for the concepts and skills they are (32) 

learning. 



Other teachers give more attention to i— i i— i 
questions that require synthesis and ' — ' «— ' 
analysis. (68) 



Other teachers place a higher priority i — i r— i 

BUT on helping studenls to identify global *— ' L-J 

relations. (32) 

Other teachers rarely make use of i— i r- i 

concrete materials and visual aids to ' — ' ' — ■ 
assist students' learning of 

mathematical vocabulary. (18) 



Other teachers pause to make sure i— i 
everyone has time to think about the LJ LJ 



question. 



(100) 



Other teachers arc more concerned with i — i r— * 
having students get the correct solution. ' — ' LJ 



(6) 
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Really True Sort of True 
For Me For Me 

pj r-j Some leachers ask studenls to clarify or 

' — ' extend Iheir responses. 



rn r-i Some teachers seldom find time to 

LJ encourage students to check their 

answers against estimates or standards 
of "reasonableness." 



r~] pi Some teachers incorporate the use of 

hand-held calculators into their math 
instruction. 



r~j pi Some teachers conduct almost all of 

L - 1 their instruction cither in large groups 

or wilh individual students. 



BUT 



Other teachers hold the view that 
clarifications and extensions by students 
are likely to confuse other students. 



Sort of True 
For Me 

□ 



Really True 
For Me 

□ 



BUT ° lhCr lcachcrs cnc0uf age students to pi ^ 

check their problem solutions against «— » LJ 



initial estimates and standards of 
"reasonableness." 



BUT ° lher leachers P rcfcr 001 10 all °w r-i r-, 

students to use calculators in class, «— J L J 



BUT ° lher lcachcrs P rovide students with r-i r-* 

many opportunities to work in small LI LJ 

groups of four or five students. 
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APPENDIX C 



MONTEREY BAY AREA MATHEMATICS PROJECT 
Yeai — End Participant Interview 
1986-87 



During t ns past yea. (and not including the MBAMP summer 
institute and its monthly meetings), have you 
participated in other professional development activities 
pertaining to mathematics? 

.If yes, has your participation in such activities been 

considerably more than last year? 

more than last year? 

about the same as last year? _ 

less than last year? ~ 

considerably less than~last year? 

(If answer to #1 was yes): What are some examples of 
these activities? 



Have you planned and presented (or assisted in 
planning and presenting) any mathematics oriented in- 
service activities or workshops for other teachers'? 
Yes No 

If yes, in how many such activities have vou 
participated? y 

TAi- you estimate have p-rtiei P .t.d ln 

2SninS^h h S PMt V«* r » have any of your colleagu.s 
approached you for suggestions about mathematics 
curriculum or instruction? Yes No 

If yes, have these requests been 

considerably more frequent than last year' 
more frequent than last year? 
about the same frequency as last year' 
less frequent than last year? — 
considerably less frequent than last year' 
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4. Has your teaching of mathematics changed any way as a 
result o-f participation in the Monterey Bay Area 
Mathematics Project? 

.If yes, What are some examples of these changes? 



5. Are there changes you hoped to make, but couldn't? 
.If yes, Please give some examples: 



6. Are there any factors that make it difficult to make 
changes you would like to? Yes No 

.Please give some examples. 



7. In leading discussions of mathematics instruction with 
your peers, administrators, or parents do you feel 

much more comfortable, 

more com'ortable, 
less comfortable, _'_ 
much less comfortable, __ 
about the same, 



8. 



as compared to your feelings prior to this past year? 

For each of the following organizations, please tell me 
if you are currently a member, and if you attended any 
meetings sponsored by the organization during the past 

National Council for Teachers of Mathematics 
. Member? Yes __ No 

. Attended conference or meetings? Yes No 

California Mathematics Council 

. Member? Yes No 
. Attended? Yes No 

Local or Regional Mathematics Association 

. Member? Yes No 
. Attended? Yes No 



9. Do you have any final comments to offer that would be 
helpful to the evaluation of the project? 
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